Scale-Free Structure Emerging from Co-Evolution of a Network and the 
Concentration of Diffusive Resources on It 
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Co-evolution involving the intricate interplay between dynamics both on and of a network is a 
key concept for understanding the self-organized flexible nature of real- world network systems. We 
propose a simple model of such co-evolving network dynamics, in which the diffusion of resources over 
the weighted network and the evolution of the link weights occur simultaneously. We demonstrate 
that, under feasible conditions, the network robustly acquires a scale-free structure characterized by 
power-law distributions with an exponent of —1 (Zipf's law). Our model offers a novel framework for 
understanding the network structures pertinent to resource distribution over a network in real- world 
systems. 
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Today, the term network is common in our everyday 
lives, in which it refers to large-scale, complex-structured, 
unsteady interactions in many real-world systems. These 
networks are not static, but changing in response to the 
activity of the systems existing on them. For example, 
in social networks, such as friendship and coauthorship, 
human behavior is highly influenced by social relation- 
ships, and at the same time, the relationships among 
people changes continually as a result of their behavior. 
This intricate interplay between individuals and their re- 
lationships causes emergence of the complex structures of 
human societies [H HJ • Similar dynamics are exhibited by 
traffic networks among cities supporting the transporta- 
tion of people and products. As cities develop, these net- 
works are improved to meet the increasing needs, and in 
turn the improved efficiency of the traffic network facili- 
tates further development of the cities. A similar process 
takes place in the case of communication networks Q. 
The essence of above real-world systems resides in the 
co-evolving dynamics of the system interacting on the 
network and the underlying network structure. To un- 
derstand the underlying mechanism of such dynamical 
network organization, we have to consider mutual inter- 
play between dynamics both on and of a network. 

In the last decade, there have been two major research 
trends with the goal of understanding the co-evolving dy- 
namics described above. One focuses on the topology of 
the network. It is well known that real-world networks 
share some common topological features [4 6] . One typ- 
ical feature is a scale-free structure, which means that 
the node degree (the total number of links connected to 
a node) exhibits a power-law distribution 0, 0] • To ex- 
plain the emergence of such topological features, mod- 
els of network evolution dynamics are widely used. The 
other trend is to address the nature of dynamical sys- 
tems interacting on static networks. This approach re- 
veals how the topological structure of the interactions 
affects on the collective behavior, such as magnetization, 
synchronization and spreading [8| . 

Most studies employing the above two approaches have 



focused on only one of two aspects of co-evolving dynam- 
ics: evolution of the network topology or evolution of the 
states on the network. We propose to integrate these 
two trends into a unified theory that takes account of 
the interplay between dynamics both of and on the net- 
work. Although there have been several studies treating 
the dual dynamics of such co-evolving networks fur- 
ther systematic studies employing the point of view of 
dynamical systems are needed. 

The aim of this paper is to propose a fundamental the- 
oretical model to understand the nature of co-evolving 
dynamics. Among the possible dynamical processes on 
a network, diffusion is a fundamental process related to 
many physical and social phenomena. We thus consider 
diffusive resources at nodes, which may be, for example, 
molecules, cells, people or money. The quantity of this 
resource can be regarded as representing the state of the 
system of the nodes. For the time evolution of the net- 
work structure, we assume that the link weight changes 
according to a simple formula inspired by the law of mass 
action. 

Let us consider a weighted network of N nodes, on 
which wc consider simple co-evolving network dynamics, 
as illustrated in Fig. HJa). The link structure of the 
network is defined by the adjacency matrix , in which 
ay=l if a link between the nodes i and j exists and 
otherwise. We assign a time-dependent weight Wij(t) to 
each existing link (a,j = 1). This weight represents the 
strength of the interaction. In addition, we assume that 



these weights are symmetric, i.e., Wij(t) 



w 



i(t). On 



this weighted network, we assume that some diffusive 
resource exists in some quantity of each node, denoted 
by Xi(t) (i = 1, 2, • • • , N). The diffusion process can be 
understood as the diffusion of many random walkers, in 
which the walkers at the node i move to the neighboring 
node j in accordance with the time-dependent weighted 
probability Wji(t)/si(t). Here, Si(t) is the strength of 



the node i defined by Si(t) = X^ga^ w ji(t) 
the set of nodes connected with the node 



where A/i is 
The master 
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FIG. 1: (a) A schematic illustration of co-evolving dynamics, 
in which the topology of the network and the dynamical states 
of the nodes influence each other. In our model, some resource 
Xi of the ith node is transported diffusively to the neighboring 
nodes through the weighted links toy , while the weights of the 
links evolve in a resource-dependent fashion, (b) A typical 
network structure emerging through the co-evolving dynamics 
described by equations (1) and (2) with e = 0.01. The initial 
topology is chosen to be the Erdos-Renyi random graph with 
link probability p=0.1 and network size iV=512. The size of 
node represents the amount of the resource x% at that node on 
a log-scale. The link structure of the network becomes blurred 
because the number of links becomes very large, (c) The 
resource distribution asymptotically converges to a power-law 
with exponent —1. The inset displays a log- log plot, with a 
fitting line satisfying P x oc x . The parameter values are 
the same as in (b), except that N = 16384 and p = 0.01. 
(d,e) Correspondingly, the weights Wij and the strengths Sj 
(= J^j-gjy. Wi i) a ^ so exhibits power-law distributions with the 
same exponent. In all simulations, the initial resources and 
weights were generated by a normal distribution with mean 
fi = 1 and standard deviation a = 0.1 (for weights), 0.25 (for 
resources) . 



equations for diffusion of the resources are thus given by 



a{t + i)-xi(t) = J2 



Sj (t) "> 



Xj {t) - Xi (t). (1) 



The first and second terms are the inward and outward 
current of the resource with respect to the node i, re- 
spectively. Note that the total quantity of the resource 
is conserved, i.e. , ^2iXi(t)/N = 1. 

We assume that the evolution of the weight tiiy (t) de- 
pends on the product of the quantities of the resource 



at the endpoint nodes of the link, Xi(t)xj(t). In partic- 
ular, as one of the simplest cases, we first examine the 
situation in which the weight Wij(t) relaxes to Xi(t)xj(t) 
(the law of mass action). Therefore, the dynamics of the 
weights is described by 



it't 



i(t + 1) - w i:i (t) = e [xi(t) Xj (t) - Wij {t)] , (2) 



where the parameter e represents the relaxation time 
scale of the weight dynamics. 

The topology associated with the link structure of the 
network is characterized by the adjacency matrix ay. 
In this model, we assume that ay is time independent. 
Thus, only the weights Wij(t) of the links (ay=l) change, 
according to equation (2). In the following, first we 
choose various types of the topologies ay, and then we 
investigate the co-evolving dynamics of the weights wy (t) 
and the quantities of resource xi (t) on the network with 
each given topology ay. It should be noted that the 
co-evolving dynamics do not exclude the possibility that 
some links are effectively disconnected, that is ay = 1 
but Wij(t) — > 0. 

Interestingly, we found that the simple dynamics pre- 
sented above can yield power-law distributions of the re- 
sources and the weights even when the underlying topol- 
ogy of the network is not scale- free. Figures Qlb)-(e) 
display a typical result of the numerical simulations of 
equations (1) and (2) with e = 0.01, where a Erdos-Renyi 
(ER) random graph is used for the topology of the net- 
work ay . A typical example of the network is shown in 
Fig. [Hb), where a few resource-rich nodes can be seen. 
In Fig. HJc), we see that the distribution of resources be- 
comes broader with time and asymptotically converges 
to a power-law distribution with an exp onent of — 1. 
This distribution is called Zipf's law [101 . Evidence of 
this empirical law is observed in many physical and so- 
cial phenomena, such as word frequencies in natural lan- 
guages, populations of cities, statistics of Web access, 
and company sizes and economic activity fll| . Similarly, 
the weights iuy and strengths Sj also exhibit power-law 
distributions with the same exponent (see Fig. [ljd)-(e)). 



The strength Sj (=J2 



) is an important measure 



of weighted networks. It can be regarded as a natural 
generalized version of the degree, taking into account the 
importance of the weights of links. Therefore, it is under- 
stood that a power-law distribution of the strengths in 
the weighted network corresponds to a scale-free topol- 
ogy in a network without weighted links. Hence, we can 
conclude that a scale-free structure emerges through the 
co-evolving network dynamics. The results of our ex- 
tensive numerical simulations under various conditions 
suggest that the emergence of this scale-free structure 
is generic. In particular, the exponent of the power-law 
distribution is — 1 under various conditions of underlying 
topologies, initial conditions and the parameter e. 

To determine the types of resource dependence of the 
weight dynamics that can generate a scale-free weighted 
network, instead of equation (2) we consider the general- 
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FIG. 2: Two types of network formation resulting from different types of resource dependence of the weight dynamics. A 
resource dependence characterized by the parameter a as Awij oc (xiXj) a — Wij, is introduced, (a) Starting from an initial ER 
random graph with link probability p = 0.1 (middle graph), the co-evolving network dynamics yields a scale-free structure with 
a power-law resource distribution for a = 1.125 (right graph) and a non-scale-free structure for a = 0.5 (left graph), (b) The 
dependence of the strength distribution on the imposed topology of the network and the type of the weight dynamics. The 
top three graphs correspond to three types of weight growth as a function of the quantity of the resource Awij ~ xfx'j oc x a 
: increasing concave (a = 0.75), linear (a = 1) and convex functions (a = 1.25). The middle and bottom graphs plot the 
strength distributions obtained in numerical simulations for the ER random graph and the regular random graph, respectively. 
The network size N = 16384, the mean degree (k) ~ O.OliV, and the other parameter values are the same as in Fig. [1] 



ized form 

WlJ (t + 1) - Wij (t) = e [(xi(t) Xj (t)) a - Wijit)} , (3) 

where a is a parameter controlling the non-linearity of 
the resource dependence. 

We investigated how the resource dependence of the 
weight dynamics affects the network formation. Figure 
[2] summarizes the obtained results, in which two dis- 
tinct types of network structures appear through the co- 
evolving network dynamics, as determined by the value 
of a. In the case a > 1, we see that a few very resource- 
rich nodes (hub) and many resource-poor nodes coexist 
as a result of the emergence of the power-law resource 
distribution. Contrastingly, in the case a < 1, the re- 
sources are almost evenly distributed at all nodes, and 
no prominent hubs appear in the network. 

We analyze the asymptotic behavior of the system 
by making some approximations to obtain meaningful 
results. Let us first consider separately two types of 
dynamics of the resources and weights. First, if the 
link weights are static, the resources Xi converge to 
the equilibrium solution x* = s-s/(X}fc S k/N) of equa- 
tion (1). Second, the weights would relax to the solu- 
tion w*j = (xiXj) a if the resources Xi were held fixed. 
Then, in the actual co-evolving dynamics, the asymp- 
totic stage of the system is expected to satisfy x* = 
S i/Cl2k S k/N) and w*j = (xiXj) a . However, the situ- 
ation is more complicated, owing to the simultaneous 
change of Xi and Wij. For this reason, the asymptotic 
dynamics are qualitatively approximated by updating 
the variables Xi and ro,j in an alternating manner us- 



ing two maps, Xi(n + 1) = Si(n)/(^2 k Sk(n)/N) and 
then Wij(n + 2) = (xi(n + l)xj(n + 1))", where n de- 
notes the number of the iteration. Although this ap- 
proximation might be too crude, the obtained results 
exhibit reasonable agreement with the numerical sim- 
ulations, as shown below. Eliminating Xi(n) and us- 
ing the update rule for the strength Si (= X^gaT w v)y 
we obtain Si(n + 1) = c n Si(n) a ^2j=i a ij s o ( n ) a -i where 
c n = ^/(J2k s k{ n )/N) 2a . In addition, we assume that 
the network topology is given by a regular random 
graph, which means that each o^- is random, but J"\ 
is a constant, fcrj. Ignoring the constant multiplier in- 
dependent of the subscription i, we finally obtain the 
following relation for the strength after n iterations with 
the initial value Sj(0): 

Si (n) oc Sl (0) Q ". (4) 

The asymptotic behavior resulting from the dynamics de- 
scribed by the above rules can be classified into three 
cases, corresponding to three cases for the value of a: 
a > 1, a < 1 and a = 1. 

In the case a > 1, for a given initial strength dis- 
tribution P°(s), we have P n (s) oc P°(s Q ~")s~ 1+Q ~". 
For example, if P (s) is a normal distribution with 
zero mean and variance c 2 , we obtain P n (s) oc 
cxp(— s 2a /2<7 2 )s~ 1+Q . In the asymptotic limit n — > 
oo, the distribution P n (s) behaves as P n (s) — > s . In 
Fig. HJb), it is seen that this power-law strength dis- 
tribution appears not only in the case of a regular ran- 
dom graph but also in the case of an ER random graph. 
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This suggests that the above analytic result holds for a 
more general network topology. The essential mechanism 
underlying the emergence of scale-free structure can be 
intuitively understood by considering the fact that the 
weight growth for a > 1 is describe by an increasing con- 
vex function of the resource quantity, as shown in the 
top graph of Fig. &b). This convexity implies that the 
link weight of a node increases when the quantity of the 
resource at that node increases. This leads to the emer- 
gence of hub nodes. This scaling-up effect of the resource 
size can be interpreted as an expression of the "rich-get- 
richer law" or "economies of scale" . 

In the opposite case a < 1, Si(n) in equation (4) con- 
verges to a uniform constant in the limit n — > oo, i.e., 
Sj(n) oc s° = 1 for all i. This means that the strengths 
of nodes are homogenized to a typical size. The va- 
lidity of this theoretical prediction is numerically con- 
firmed for regular random graphs in Fig. [UJb). For ER 
random graphs, owing to the variability of the degree, 
the strengths cannot converge to identical values but, 
rather, converge to a Gaussian-like distribution with fi- 
nite variance. Note that both strength distributions for 
a < 1 have a characteristic scale, indicating a finite mean 
strength. This contrasts with the power-law distribution 
in the case a > 1. As shown in Fig. HJb), the weight 
growth function for a < 1 is an increasing concave func- 
tion. Thus, in this case, the increase in the weight slows 
as the quantity of the resource increases. This leads to 
the situation in which that an almost homogenous net- 
work with no hubs is realized in the asymptotic state. 

In the critical case a = 1, a very delicate situa- 
tion arises. Theoretically, according to equation (4), 
the strength after n iterations is given by s(n) = s(0), 
and thus the strength distribution does not change, i.e., 
P"(s) = P°(s). However, this result is inconsistent with 
the numerical results, as we have already seen that a 
power-law strength distribution is realized even for a reg- 
ular random graph (Fig. [5]). We conjecture that the 
approximation inherent in the alternating update is not 
sufficiently accurate to capture the exact nature of the 



co-evolving dynamics for a = 1. The only exception is 
the case of a complete graph. In this case, the strength 
distribution remains unchanged, as predicted by the an- 
alytic treatment. However, the asymptotic distribution 
changes drastically, becoming a power-law distribution, 
when only a few links are removed from the complete 
graph (data not shown). Thus, the system robustly ac- 
quires a scale-free structure in realistic situations. 

In this paper, we have proposed a simple, fundamen- 
tal model of a co-evolving weighted network, in which 
the quantity of the resource at a node diffuses over a 
weighted network and simultaneously, the link weights 
evolve in a resource-dependent manner (the law of mass 
action). We have demonstrated numerically and ana- 
lytically that, as a result of the co-evolving dynamics, 
the weight and resource distributions exhibit power-law 
forms, with exponent —1. Moreover, we have investi- 
gated what type of resource dependence in the weight 
dynamics allows the system to acquire scale-free struc- 
ture. This behavior can qualitatively be explained by a 
map equation that approximately describes the dynamics 
of the strength distribution in closed form. 

These findings provide novel insight into the functional 
meaning of network structure, because an organized net- 
work structure is directly related to resource diffusion on 
network through co-evolving dynamics. In general, dif- 
fusion processes are fundamental in many phenomena in 
real- world networks. Therefore, this simple framework 
of co-cvolving dynamics is applicable to a wide range 
of diffusion-based systems, such as chemical reaction- 
diffusion, prey-predator systems and population dynam- 
ics, which is practically meaningful in real-world sys- 
tems. We believe that, the study of co-evolving dynam- 
ics should helps us to elucidate the functional network 
structures pertinent to the resource distribution over a 
network and provide a perspective for designing adap- 
tive structures of networks. 
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